On cross-validated Lasso in high dimensions
نویسندگان
چکیده
In this paper, we derive nonasymptotic error bounds for the Lasso estimator when penalty parameter is chosen using K-fold cross-validation. Our imply that cross-validated has nearly optimal rates of convergence in prediction, L2, and L1 norms. For example, show model with Gaussian noise under fairly general assumptions on candidate set values parameter, estimation converges to zero prediction norm slogp/n×log(pn) rate, where n sample size available data, p number covariates s nonzero coefficients model. Thus, achieves fastest possible rate up a small logarithmic factor log(pn), similar conclusions apply both L2 Importantly, our results cover case (potentially much) larger than also allow non-Gaussian noise. paper therefore serves as justification widely spread practice cross-validation method choose estimator.
منابع مشابه
Cross-Validated Bagged Learning.
Many applications aim to learn a high dimensional parameter of a data generating distribution based on a sample of independent and identically distributed observations. For example, the goal might be to estimate the conditional mean of an outcome given a list of input variables. In this prediction context, bootstrap aggregating (bagging) has been introduced as a method to reduce the variance of...
متن کاملCross validation in LASSO and its acceleration
We investigate leave-one-out cross validation (CV) as a determinator of the weight of the penalty term in the least absolute shrinkage and selection operator (LASSO). First, on the basis of the message passing algorithm and a perturbative discussion assuming that the number of observations is sufficiently large, we provide simple formulas for approximately assessing two types of CV errors, whic...
متن کاملAnger Status and its Dimensions among High School Female Students: A Cross-Sectional Study
Aims: Anger is one of the excitements of human, which, if left out of a balanced level and transformed into aggressive behavior, has many negative effects on all aspects of the health of individuals. Awareness of anger status in adolescent students and its effective factors can be the first step in planning and implementing psychological interventions to control and management of students’ ange...
متن کاملThe lasso, persistence, and cross-validation
During the last fifteen years, the lasso procedure has been the target of a substantial amount of theoretical and applied research. Correspondingly, many results are known about its behavior for a fixed or optimally chosen smoothing parameter (given up to unknown constants). Much less, however, is known about the lasso’s behavior when the smoothing parameter is chosen in a data dependent way. T...
متن کاملThe Culture, Intercultural and Cross-cultural Dimensions in Communication
Culture as the philosophy of life refers to the values, norms and rules, and actual behaviorwhich is taken over by man from the past generations, and to leave it to next generation in a differentform, separates individuals belonging to the culture from individuals belonging to other cultures.Each of these different attitudes describes the degree to which the culture values the past, the present...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Annals of Statistics
سال: 2021
ISSN: ['0090-5364', '2168-8966']
DOI: https://doi.org/10.1214/20-aos2000